Creation of image file

ABSTRACT

The technique of the present invention ensures generation of an image file, in which image data and additional data are included, with the confidentiality of specific data kept.  
     An image output system outputs the image data, which is generated in a digital still camera DSC  12,  with a color printer  20.  The DSC  12  encrypts image processing control data, which is preset by the manufacturer, and generates the image file, in which the image data and the encrypted image processing control data are included. The color printer  20  decodes the image processing control data included in the image file, performs image processing based on the image processing control data, and thereby outputs an image.

TECHNICAL FIELD

[0001] The present invention relates to a technique of generating animage file, in which image data and additional data are associated oneanother.

BACKGROUND ART

[0002] A digital still camera (DSC) is configured to record an image inthe digital data format using a CCD. A liquid crystal display mounted onthe DSC allows a photographer to view and delete the image that has beenshot. One applicable procedure using a general-purpose personal computerincludes output of the image data, which has been shot by the DSC, suchas displaying on a monitor and printing with a printer.

[0003] Respective DSCs have different characteristics in the colorbrightness or the color tone of a subject corresponding to amanufacturer and a type of a device. The difference depending on a typeof an image output device causes such difference in the characteristics.In many cases, intentions of the photographer are not reflected on aresulting output image due to such difference.

[0004] Thus, the present invention provides a technique of utilizing theimage file, in which image processing control data is added to the imagedata for controlling image processing. In the image file, a couple ofshooting conditions, such as the shutter speed and the exposure time,are included. Such additional data, however, includes pieces of specificinformation that is uniquely set by each manufacturer of the DSC inorder to present its own originality, which is undesired to be disclosedfor the details. The image data itself is also undesired to bedisclosed. As to the confidentiality regarding such data, nothing hasbeen taken into consideration.

[0005] Those problems are discussed herein exemplifying the DSC;however, similar problems arise in an image data generation apparatus,such as a digital video camera and a scanner.

[0006] The object of the present invention is thus to provide atechnique that ensures generation of the image file, in which the imagedata and the additional data are associated one another, with theconfidentiality kept.

DISCLOSURE OF THE INVENTION

[0007] To attain at least part of the above and the other relatedobjects, the present invention adopts the following structure.

[0008] In accordance with one aspect of the present invention, a firstimage file generation apparatus that generates an image file, in whichimage data and additional data of the image data are associated oneanother, comprises:

[0009] a data input module that inputs the image data and the additionaldata;

[0010] an encryption module that encrypts part of the image data and theadditional data; and

[0011] an image file generation module that generates the image file, inwhich the image data and the additional data are associated one another,part of the image file being encrypted.

[0012] The image file generation apparatus of the present inventionenables generation of the image file, in which the image data and theimage additional data of the image data are associated one another.Association may include two forms; both data are integrally included andrespective data is included in different files formally, in which apiece of information for associating both data one another is includedin at least one of two files. The term “include” or “associate” in thespecification means the former form in a narrow sense, and both theformer and the latter forms in a broad sense. The image file in the Exifformat includes, for example, both a storage area for the image data anda storage area for the additional data. The additional data includes,for example, image processing control data and image acquisitioninformation.

[0013] The “image processing control data” herein is data forcontrolling the image processing that is performed on the image data byan image processing device. The image processing device functions toanalyze this image processing control data and automatically setparameters for the image processing to be performed. This parameter, forexample, includes parameters regarding “the contrast”, “the brightness”,“the color balance”, “the saturation”, “the sharpness”, “the gammavalue” and “the target color space”. “The target color space” is aparameter that specifies the color space used for the image processing,based on the color space, such as a sRGB color space or a NTSC, whichhas been employed relating to generation of the image data. The imageacquisition information on the DSC includes various shooting conditions,such as the shutter speed, exposure and aperture.

[0014] In general, each manufacturer of the image file generationapparatus uniquely sets such additional data, and the additional data isthus undesired to be disclosed. The details of the additional data areparticularly concealed from any competitor in many cases. In accordancewith the present invention, part of the image data and the additionaldata, for example, which is undesired to be disclosed withoutlimitation, is encrypted. As a result, the confidentiality of theadditional data may be secured regarding the image file, in which theimage data and the additional data are associated one another.

[0015] The image data may be encrypted in the present invention. Forexample, encryption of original image data of the image file, whichincludes thumbnails and the original image data, enables display ofthumbnails, but prevents display of the original image, without beingdecoded.

[0016] In accordance with the present invention, not all but part of theimage data and the additional data are encrypted, and thus, unencrypteddata is available without being decoded. For example, when only theadditional data is encrypted, an image output device, which is unable todecode the data, fails to utilize the additional data, but can outputthe image data.

[0017] In accordance with another aspect of the first image filegeneration apparatus, a diversity of cryptosystems may be applied to theencryption. One applicable example includes a secret key cryptosystem,in which a transmitter and a receiver share a key, while anotherapplicable example includes a public key cryptosystem, in which atransmitter and a receiver use different keys. In the present invention,it is preferable to employ the public key cryptosystem, which uses thepublic key that is specified by the image processing device. The imagefile generation apparatus thus performs the encryption with the use ofthe specified public key. This system allows the encrypted data to bedecoded only with the use of a decode key that pairs up with thecorresponding public key, and thereby ensures the confidentiality of theimage file generation apparatus between different manufacturers.Preparing one decode key enables the image processing device to match aplurality of image file generation apparatuses provided by differentmanufacturers.

[0018] In the case of the secret key cryptosystem using a common key, itis preferable to use different encryption keys depending on themanufacturer or the type of the image file generation apparatus. Thissystem causes the image processing devices to hold decode keys, each ofwhich corresponds to the manufacturer of the image file generationapparatus.

[0019] In accordance with yet another aspect of the first image filegeneration apparatus of the present invention, the additional data mayinclude image processing control data used for the image processing onthe image data, and the encryption module may encrypt at least the imageprocessing control data.

[0020] This ensures the confidentiality regarding the image processingcontrol data, which is uniquely set by the manufacture.

[0021] The present invention is also directed to a second image filegeneration apparatus that generates an image file, in which image dataand additional data of the image data are associated one another,comprises:

[0022] an image data input module that inputs the image data;

[0023] an additional data input module that inputs the additional data,at least part of which is encrypted; and

[0024] an image file generation module that generates the image file, inwhich the image data and the additional data are associated, and atleast part of which is encrypted.

[0025] In accordance with the present invention, the image file isgenerated using the additional data, at least one of which has beenencrypted in advance. This ensures the confidentiality regarding theadditional data without installation of the encryption module in theimage file generation apparatus.

[0026] A diversity of data may be included in the additional data in thepresent invention. For example, the additional data may be outputcontrol data that controls the output of the image on the image outputdevice. One example of the output control data includes a printinginstruction where a color printer is used as the image output device.

[0027] In accordance with the present invention, the image filegeneration apparatus may be applied to a diversity of the image datageneration apparatuses, such as digital cameras. The digital camera maybe a DSC or a digital video camera.

[0028] The present invention is also directed to an image processingdevice that performs specific image processing on image data. Thisembodiment and the image file generation apparatus as described are in asub-combination relationship each other.

[0029] In accordance with one aspect of the present invention, the imageprocessing device that performs the specific image processing on theimage data, comprises:

[0030] an image file input module that inputs an image file, in whichthe image data is associated with the image processing control data usedfor the image processing on the image data, part of which is encrypted;

[0031] a decoder that decodes encrypted part of the image file; and

[0032] an image processing module that performs the specific imageprocessing on the image data, based on the image processing controldata.

[0033] The decoder stores a piece of information, such as a decode keythat pairs up with the corresponding encryption key, which is requiredfor decryption.

[0034] In accordance with another aspect of the present invention, theimage processing device further comprises:

[0035] an image processing control data storage module that stores theimage processing control data,

[0036] wherein the image processing module performs the specific imageprocessing on the image data, based on the image processing control datastored in the image processing control data storage module when theencryption module fails to decode the encrypted part of the image file.

[0037] This enables the image processing on the image file that isunable to be decoded.

[0038] The image processing device of the present invention may beapplied to diversity of image output devices, such as a color printer.It is not restricted to the color printer, but may be a monitoringdevice, such as a CRT display or a liquid crystal display.

[0039] The present invention is also attained by a computer readablerecording medium in which at least part of the encrypted additional datais recorded. The additional data recorded in the recording medium thusenables the image file generation apparatus of the present invention togenerate the image data.

[0040] In addition to the image file generation apparatus and the imageprocessing device as discussed previously, the technique of the presentinvention may also be actualized by an image file generation method andan image processing method. The technique of the present invention isfurther achieved by a computer program attaining such a method, arecording medium in which such a computer program is recorded, and adata signal including such a computer program and being embodied in acarrier wave. Any of the diverse conversion processes may be appliedselectively.

[0041] When the technique of the present invention is attained by thecomputer program or the recording medium in which such a computerprogram is recorded, the computer program may be the whole program fordriving the image file generation apparatus and the image processingdevice or only the partial program for attaining the characterizedfunctions of the present invention. Typical examples of the recordingmedium include flexible disks, CD-ROMs, magneto-optic discs, IC cards,ROM cartridges, punched cards, prints with barcodes or other codesprinted thereon, internal storage devices (memories like a RAM and aROM) and external storage devices of the computer, and a variety ofother computer readable media.

BRIEF DESCRIPTION OF THE DRAWINGS

[0042]FIG. 1 schematically illustrates the construction of an imageoutput system 10.

[0043]FIG. 2 shows modifications of an image output system 10.

[0044]FIG. 3 is a block diagram illustrating the schematic structure ofa DSC 12.

[0045]FIG. 4 shows functional blocks of a DSC 12.

[0046]FIG. 5 shows parameters of image processing control data.

[0047]FIG. 6 shows the structure of an image file 100.

[0048]FIG. 7 shows the detail hierarchical structure of the image file100.

[0049]FIG. 8 is a schematic diagram illustrating one example of datastored into a MakerNote data storage area 103.

[0050]FIG. 9 is a flowchart illustrating the process of generating animage file 100 in accordance with the first embodiment.

[0051]FIG. 10 shows functional blocks of a DSC 12A in accordance withthe second embodiment.

[0052]FIG. 11 is a flow chart illustrating the image processing routine.

[0053]FIG. 12 is a flow chart illustrating image processing based onimage processing control data.

BEST MODES OF CARRYING OUT THE INVENTION

[0054] Some modes of carrying out the invention are discussed below asembodiments in the following order:

[0055] A. Construction of Image Output System:

[0056] B. Image File Generation Apparatus:

[0057] C. Structure of Image File:

[0058] D. Generation of Image File:

[0059] E. Image File Generation Apparatus in accordance with SecondEmbodiment

[0060] F. Image Output Device:

[0061] G. Image Processing on Image Output Device:

[0062] H. Modifications:

[0063] A. Construction of Image Output System

[0064]FIG. 1 schematically illustrates the construction of an imageoutput system 10 in one embodiment of the present invention. The imageoutput system 10 of the prevent invention includes a DSC 12 and a colorprinter 20. The DSC 12 is used as an image file generation apparatus.The color printer 20 is used as an image processing device and an imageoutput device.

[0065] The DSC 12 functions to set various shooting conditions, shootingmodes and output control data PIM. Available example of the shootingcondition includes the condition for acquiring the image data, such asthe shutter speed, exposure and aperture. The “shooting mode” is a groupof parameter values that is set based on various shooting scenes. Oncethe user selects the shooting mode, each parameter value, such as theshutter speed, is automatically set. The output control data PIM is datarequired to control image processing and printing with the color printer20, and includes image processing control data used for the imageprocessing and a printting instruction. The DSC 12 does the shootingunder the shooting condition, which is set by the user, and generates animage file, in which the image data and the output control data PIM areintegrally included. A resulting image file is stored into a memory cardMC.

[0066] The color printer 20 has a function of image processing. Thecolor printer 20 receives input of the image file via the memory card MCor a cable, and then analyzes the output control data PIM. The colorprinter 20 performs the image processing on the image data, based on theimage processing control data, which is included in the output controldata PIM, and thereby executes the printing.

[0067] As mentioned above, the image output system 10 in accordance withthe present invention controls the printing with the color printer 20 toexecute the printing that reflects the intention of the photographer.The details about the DSC, the image file and the color printer will bediscussed below.

[0068] A diversity of embodiments may be applied to the image outputsystem 10. FIG. 2 shows modifications of the image output system 10. Theimage output system 10 may include a personal computer PC incorporatinga function of the image processing, a server SV and a monitor 14 used asthe image output device. A scanner and a digital video camera may alsobe connected to the system as the image file generation apparatus.Respective devices are connected together with a cable CV or a wirelesscommunication locally or via a network in order to receive data.

[0069] B. Image File Generation Apparatus

[0070]FIG. 3 shows functional blocks of the DSC 12. The respectivefunctional blocks are actualized by software or hardware configuration.

[0071] The DSC 12 does the shooting with a CCD or a photomultiplier. TheDSC 12 includes an optical circuit 121 having the CCD, an imageacquisition circuit 122 controlling the optical circuit 121, an imageprocessing circuit 123 causing the acquired digital image to beprocessed and a control circuit 124 having a CPU, ROM and RAM andcontrolling each circuit.

[0072] The DSC 12 stores the acquired image into the memory card MC asthe digital data. A typical format for storing the image data is JPEG.Any other formats, such as TIFF, GIF and BMP, are also available.

[0073] The DSC 12 has a Select/Set-up button 126 for various settings ofregarding the shooting mode and the image processing control data, and aliquid crystal display 127 for displaying an image preview window and aset-up window of every kind.

[0074] The “shooting mode” is a group of parameters, which is setcorresponding to the shooting scene. This parameter, for example,includes parameters regarding the exposure time, the white balance, theaperture, the shutter speed and the focal length of lens or the like.Once the user selects the shooting mode, respective parameter values areautomatically set corresponding to the selected shooting scene.

[0075] “The image processing control data” is data regarding the outputof the image, such as the contrast, the brightness and the saturation,which is used for the image processing in the color printer 20. In thisembodiment, plural sets of the image processing control data are presetcorresponding to the shooting mode. The details about the relationshipbetween the shooting mode and the image processing control data will bediscussed below.

[0076]FIG. 4 shows functional blocks of the DSC 12 in accordance withthe first embodiment of the present invention. The respective functionalblocks are actualized by software or hardware configuration.

[0077] An image data generation module 12 a generates the image data. Animage data input module 12 b inputs the image data.

[0078] An image processing control data input module 12 d inputs theimage processing control data from an image processing control datastorage module 12 c. The image processing control data input module 12 dacquires the image processing control data from an external storageunit, such as a hard disc of a personal computer PC, a server SV and arecording medium.

[0079] An encryption module 12 e encrypts the image processing controldata using a public key that is specified by the manufacture of theimage processing device. A diversity of systems is available forencryption. In this embodiment, a public key cryptosystem known in theart is applied. A decode key is concealed by the manufacturer of theimage file generation apparatus, and thereby ensure the confidentialityof the image processing control data between manufacturers of image filegeneration apparatuses.

[0080] An image file generation module 12 f generates the image file, inwhich the image data and the encrypted image processing control data arestored in a specific format.

[0081]FIG. 5 shows image processing control data. In this embodiment,eleven sets of parameters are preset by the manufacturer of the DSC 12corresponding to shooting scenes. Each set includes seven items ofparameters, that is, “the contrast”, “the brightness”, “the colorbalance”, “the saturation”, “the sharpness”, “the registered color” and“the noise removal”. Those parameters are provided by the manufacturerof the DCS 12. The parameter and parameter values, which are applied toeach shooting mode, are stored into ROM incorporated in the controlcircuit 124 in the DSC12. The user may set the shooting mode using theSelect/Set-up button 126.

[0082] The DSC 12 generates the image file, in which the imageprocessing control data corresponding to the additional data that isset, and the image data are integrally included, and then stores theresulting image file into the memory card MC. In addition to the imageprocessing control data, the image file includes the shooting condition,such as the gamma value of the DSC 12, the target color space, theexposure time, the white balance, the aperture, the shutter speed andthe focal length of lens.

[0083] C. Structure of Image File

[0084]FIG. 6 shows the structure of an image file 100. According to thisembodiment, the image file 100 adopts a specific file structure inconformity with the Exif (Exchangeable Image File) format standard forDSC. The Exif file specification was established by JEITA (JapanElectronics and Information Technology industries Association).

[0085] The image file 100 includes an image data storage area 101 and anadditional information storage area 102. The image data is stored intothe image data storage area 101 in the JPEG format. The additionalinformation is stored into the additional information storage area 102in the TIFF format. The additional information storage area 102 includesa MakerNote data storage area 103. The MakerNote data storage area 103is undefined area left open to the manufacturer of the DSC 12. The imageprocessing control data is stored into the MakerNote data storage area103.

[0086] As known among those skilled in the art, the file in the Exifformat has a data structure that utilizes a tag in order to specify eachdata. “MakerNote” is allocated to the data stored into the MakerNotedata storage area 103 as a tag name, which is called a MakerNote tag.

[0087] Although the image file 100 is regarded as the file in the Exifformat in this embodiment, it is not restricted to this format. Theimage file may have a data structure, in which the image data and theimage processing control data are associated in any available format.The image data and the image processing control data may be integrallyincluded in one file as shown in this embodiment, or may be formallyincluded in different files. In the latter structure, at least one ofboth data preferably includes information that associates one another.

[0088]FIG. 7 shows the detail hierarchical structure of the image file100. FIG. 7(a) shows the data structure of the MakerNote data storagearea 103. FIG. 7(b) shows the data structure of a PrintMatching datastorage area 104, which is defined in the MakerNote data storage area103. PrintMatching data is used as the image processing control data.

[0089] The data stored into the MakerNote data storage area 103 may beidentified with the tag. The PrintMatching tag is allocated to the imageprocessing control data therein. Each tag in the MakerNote data storagearea 103 is specified with the pointer based on an off-set value fromthe top address in the MakerNote data storage area 103. Pieces ofinformation regarding a name of the manufacturer (6 bites), areservation area (2 bites), the number of the entries in the local tagand offset of each local tag (12 bites) are sequentially stored into theMakerNote data storage area 103. The end code “00x0”, which indicatesthe end of the data, follows the name of the manufacturer.

[0090] An identifier PrintMatching in the PrintMatching data storagearea 104 indicates that the parameter PrintMatching is stored. Aparameter specification number indicates how many parameters arespecified. A parameter number stores the value that specifies(identifies) the parameter number allocated to each parameter inadvance. Information regarding a set-up value of the parameter includesset-up value of the parameter corresponding to the specified parameternumber. In one example, the parameter number is data stored into a2-byte area, while the set-up value of the parameter is data stored intoa 4-byte area. The image output device may acquire the image processingcontrol data by utilizing the PrintMatching tag as an index.

[0091]FIG. 8 is a schematic diagram illustrating one example of the datastored into the MakerNote data storage area 103. As shown in FIG. 8, theimage processing control data, such as the gamma value, the color space,the contrast, the brightness, the color balance and the saturation,which is prepared by the manufacturer, may be stored into the MakerNotedata storage area 103. Parameter values, which are shown in the hatchedportion, are data encrypted by the encryption module 12 e. Although allparameters of the image processing control data are encrypted in thisembodiment, but it is also available to encrypt only part of the imageprocessing control data.

[0092] D. Generation of Image File

[0093]FIG. 9 is a flowchart illustrating the process of generating theimage file 100 in the DSC 12. The user sets the shooting mode prior to ashoot (Step S100). The shooting mode is selected among default shootingmodes, which are displayed on a liquid crystal display 127, with theoperation of the Select/Set-upbutton 126. A “full automatic mode” thatallows the DSC 12 to set the parameter automatically, and a “manualmode” are also prepared. Once the shooting mode is set, each parameteris automatically selected based on the preset of the image processingcontrol data, shown in FIG. 5 (Step S110).

[0094] The control circuit 124 encrypts those parameters (Step S120). Atthis step, the identifier, which indicates the encryption is processed,is attached to the encrypted parameter.

[0095] The control circuit 124 generates the image data in response to ashooting request, such as push of a shutter button (step S130), based onthe use of parameters that are set (Step S130). The control circuit 124then generates the image file 100, in which the image data and the imageprocessing control data are included (Step S140). Finally, the controlcircuit 124 stores the resulting image file 100 into the memory card MC.

[0096] Performing the sequence of the above processing enablesgeneration of the image file, which includes the encrypted imageprocessing control data. It namely ensures the confidentiality of theimage processing control data. The process of the encryption for theimage processing control data in FIG. 9 is performed prior to thegeneration of the image data, but may also be performed after thegeneration of the image data.

[0097] In accordance with this embodiment, the image processing controldata is set corresponding to the shooting mode, but may be set based onan image processing mode, which includes preset parameters in FIG. 5separately from the shooting mode.

[0098] E. Generation of Image File in Second Embodiment

[0099] In accordance with the DSC 12 in the first embodiment, theencryption module 12 e encrypts the image processing control data, whichis stored into the image processing control data storage module 12 c,and thereby generates the image file. The present invention is notrestricted to this application, but may include an application that usesthe image processing control data that has been encrypted in advance.

[0100]FIG. 10 shows functional blocks of a DSC 12A in accordance withthe second embodiment. The encryption module 12 e, shown in FIG. 4, isnot incorporated in the DSC 12A since the image processing control datastorage module 12Ac has a function of storing the image processingcontrol data that has been encrypted in advance. The DSC 12A may alsohave a encryption module to encrypt data other than the image processingcontrol data.

[0101] Accroding to the second embodiment, the process of the generationof the image file 100 on the DSC 12A is identical to that of the firstembodiment, except that the process of the encryption at step S120 inFIG. 9 is skipped.

[0102] Similar to the image file generation apparatus of the firstembodiment, the image file generation apparatus of the second embodimentmay thus generate the image file, in which the image data and theencrypted iamge processing control data are included.

[0103] F. Image Output Device

[0104] The color printer 20 as an image output device will be discussedbelow. The color printer 20 is an ink-jet printer that functions tooutput a color image and form dot patterns by ejecting, for example,color ink consisting of seven color components; cyan (C), light cyan(LC), magenta (M), light magenta (LM), yellow (Y), dark yellow (DY) andblack (K), into a printing medium to form the image. A diversity ofprinters, such as an electro photography printer, which transfers andfixates color toner on the printing medium to form the image, are alsoapplicable.

[0105] A control circuit 22 in the color printer 20 functions to readout the image file 100 from the memory card MC that is inserted into amemory card slot 24, and decode and analyze the image processing controldata with the use of the decode key. The control circuit 22 thenperoforms the image processing based on the image processing controldata that has been analyzed, and performs the printing.

[0106] G. Image Processing on Image Output Device

[0107]FIG. 11 is a flow chart illustrating image output processing,which is performed by the CPU incorporated in the control circuit 22 onthe color printer 20. Once the memory card MC is inserted into thememory card slot 24, the CPU reads out the image file 100 from thememory card MC and temporally stores the read image file 100 into RAM(Step S200). Then the CPU analyzes the header of the read image file 100(step S210), and judges as to the presence or the absence of the imageprocessing control data (step S220).

[0108] When the CPU detects no image processing control data, the CPUacquires the parameter value, which is stored into the ROM of the colorprinter 20 and thereby performs the image processing (Step S280).

[0109] When the CPU detects any image processing control data, the CPUacquires the detected image processing control data (Step S230). The CPUthen judges as to whether or not the detected image processing data isencrypted (Step S240). The CPU may perform the judgment, for example,based on the identifier that indicates if the image processing controldata is encrypted. When the data is encrypted, the decoding process isperformed on the data using the decode key (Step S250), and the imageprocessing is performed based on the image processing control data (StepS270). If the CPU fails to decode the data, the parameter value, whichis stored into the color printer 20, is acquired from ROM, and the CPUperforms normal image processing (Step S280). When the image processingcontrol data is not encrypted at step S240, the CPU performs the imageprocessing based on the image processing control data (Step S270).

[0110] The CPU finally prints out the processed image data (Step S290)and then terminates this processing routine.

[0111]FIG. 12 is a flow chart illustrating a sequence of the imageprocessing at Step S270. A double line is added to indicate theprocessing where the image processing control data is used.

[0112] The CPU fetches the image data from the image file 100 (stepS300).

[0113] As described above, the DSC 12 stores the image data into thefile of the JPEG format, where the image data is stored with a YCbCrcolor space to keep high data compression ratio (Step S310).

[0114] The CPU executes a first matrix computation to convert the imagedata in the YCbCr color space into the image data in a sRGB color space(step S310).

[0115] The CPU then carries out a gamma correction and a second matrixcomputation on the resulting image data in the sRGB color space (stepS320). In the process of the gamma correction, the CPU fetches the gammavalue on the DSC 12 from the image processing control data, and therebyperforms the process of the conversion of the gamma value into thefetched gamma value on the image data. The second matrix computation isapplied to convert the image data in the sRGB color space into the imagedata in the XYZ color space. In accordance with this embodiment, theimage file 100 may include color space information relating to thegeneration of the image data. When the image file 100 includes the colorspace information, the CPU refers to the color space information, andthereby carries out the second matrix computation applying the matrixcorresponding to the color space relating to the generation of the imagedata.

[0116] The XYZ color space is applied to the image data after theprocedure of the second matrix computation. The color space used for theimage processing with printers or computers was conventionally fixed inthe sRGB color space that prevented effective use of the color spaceapplied in the DSC 12. Contrary to the conventional type, the printer ofthe present invention utilizes the color space of the DSC 12 to attaindesirable color reproduction, and thereby changes the matrix, used forthe second matrix computation, based on the information regarding thecolor space, which is included in the image file 100.

[0117] The CPU carries out a third matrix computation and an inversegamma correction to convert the image data in the XYZ color space intothe image data in the wRGB color space, and thereby performs theadjustment of the picture quality based on the image processing controldata (step S330). The wRGB color space is defined to have the broadercolor range than the sRGB color space. In the process of the inversegamma correction, the CPU fetches a default gamma value from ROM on thecolor printer 20, and thereby performs the process of the inverse gammaconversion on the image data, applying the inverse value of the fetchedgamma value. The CPU carries out the third matrix computation applyingthe matrix included in ROM, which corresponds to the conversion into thewRGB color space.

[0118] The wRGB color space is applied after the procedure of the thirdmatrix computation. As described above, the wRGB color space is definedto have the broader color range than the sRGB color space correspondingto the color space, which is generable by the DSC 12.

[0119] The CPU subsequently performs automatic adjustment of the picturequality of the image (step S340). In this embodiment, the CPU acquireseach parameter value of the image processing control data, which isincluded in the image file 100, and thereby performs the automaticadjustment of the picture quality of the image, based on this parameterOnce the automatic adjustment of the picture quality of the image iscarried out, the CPU performs the process of the wRGB color conversionand halftoning for the printing (step S350). In the process of the wRGBcolor conversion, the CPU refers to a conversion lookup table (LUT) forconverting into the CMYK color space that corresponds to the wRGB colorspace, which is stored into ROM, and thereby converts the wRGB colorspace into the CMYK color space. Namely, the image data with tone valuesof R, G, B is converted into, for example, the image data with tonevalues of seven colors; C, M, Y, K, LC, LM, DY.

[0120] In the process of the halftoning, the tone value conversionprocess is performed on the image data with receipt of the convertedimage data. In this embodiment, the converted image data is expressed asthe data, each of which has 256-tone. Applicable examples of the processof the halftoning include the error diffusion method and the systematicdither method.

[0121] The CPU performs the process of resolution conversion prior tothe process of the color conversion to match the resolution of the imagedata with that of the printing. In addition, the CPU performs aninterlace providing process, which sorts data arrangement in the orderof forwarding the image data, which is subjected to the halftoningprocess, to the color printer 20.

[0122] As mentioned above, the color printer 20 in this embodimentenables the image data in the image file 100, which is generated by theDSC 12, to be subjected to desirable image processing to be output.

[0123] Using the image processing control data included in the imagefile enables the picture quality of the image to be adjustedautomatically without performing the adjustment of the picture qualityon a photo retouch application or a printer driver.

[0124] Although examples of the above embodiment regard the automaticadjustment of the picture quality, the adjustment process of the picturequality may also be instructed with a picture quality automaticadjustment button, which is mounted on an operation panel in the colorprinter 20.

[0125] H. Modifications

[0126] All of the diverse series of image processing or part of themdiscussed in the above embodiment may be executed in a personalcomputer, or a server SV connected to a network. Providing theapplication for image data processing, such as the retouch applicationand the printer driver, with the image processing function as discussedin FIG. 15, attains the processing on the personal computer PC. Theimage file 100 generated in the DSC 12 is provided to the computer viathe cable or the memory card MC. Upon activating the application on thecomputer by the user operation, the image file 100 is read, the imageprocessing control data is analyzed, and the image data is converted andadjusted. The series of processing described above may also be performedwith the automatic activation of the application in response todetection of the insertion of the memory card MC and the cable.

[0127] The image processing on the server SV is attained by installingthe application in the server SV, which executes the image processingfunction with reference to FIG. 12. The server SV may receive the imagefile 100, perform the image processing that is specified based on theimage processing control data and transmit the processed image file 100or the image data to the personal computer PC of transmitter or thecolor printer 20 of destination. One applicable example of printingprocess without the computer includes the transmission of a global IPaddress of the color printer 20 and the image file from the DSC 12,which has a wireless communication facility, to the server SV, and thetransmission of the processed image file 100 or the image data from theserver SV corresponding to the transmitted global IP address in return.

[0128] It is also available to select a parameter for executing theautomatic adjustment of the picture quality. For example, the colorprinter 20 may equip a parameter select button or a shooting modeparameter select button for selecting the shooting mode, in whichspecific set of parameters are preset suitable for the object of theshot. Alternatively, the parameter for performing the automaticadjustment of the picture quality on the user interface, such as theprinter driver or the retouch application, may be selected where theautomatic adjustment of the picture quality is performed on the personalcomputer.

[0129] Although the color printer 20 is used as the output device in asequence of the above-mentioned embodiments, a display device, such as aCRT, a LCD and a projector, may also be utilized. In this case, an imageprocessing program, which executes the image processing as discussedwith reference to FIGS. 14 and 15, is performed on the display device asthe output device. For example, when the CRT or the like functions asthe display device on the computer, the image processing program isexecuted on the computer. It should be understood that final outputimage data has the format not in the CMYK color space but in the RGBcolor space.

[0130] In this case, user preference relating to the generation of theimage data may be reflected on the displayed image on the displaydevice, such as the CRT, in the similar manner of reflecting the userpreference relating to the generation of the image data on the printingresult with the color printer 20.

[0131] In one available example, the image file 100, used in thisembodiment, is employed as the image file in capturing specific frame ofthe digital television broadcast, since such image data is in the formatbased on the YCbCr color space, and thus is applicable to this inventionsimilar to the case of the DSC 12. To be more precise, the image file100, in which the image data and the image processing control data isincluded, is generated by acquiring the scene to which the capture isinstructed and setting the image processing control data correspondingto the acquired image data. As a result, the image with high saturationmay be output in the case of the output of the image data, similar tothe output of the color in the digital television broadcast.

[0132] Embodiments of the present invention described herein have beenprimarily directed toward the image file generation apparatus, the imageoutput device, the image output system and the program; however, theabove embodiment and its modifications are to be considered in allaspects as illustrative and not restrictive. There may be manymodifications, changes, and alterations without departing from the scopeor spirit of the main characteristics of the present invention.

[0133] Although parameters used in those embodiments as the imageprocessing control data are, for example, the gamma value, the colorspace, the brightness and the sharpness, any parameter may be arbitraryused as the image processing control data.

[0134] In addition, respective parameters shown in FIG. 9 are to beconsidered as illustrative and not restrictive, and the invention is notto be limited to those values given herein. Furthermore, although anymatrix value of the image processing in FIG. 15 has not beenillustrated, it should be understood that those values may be changeddepending on conditions, such as the color space to be targeted or thecolor space available for the color printer 20. It is also applicable toencrypt each element of the matrix since it is one of the imageprocessing control data that influences on the image to be output.

[0135] In the first embodiment, encryption module 12 e of the DSC 12encrypts the image processing control data. The image file generationdevice in accordance with the present invention has a function ofencrypting part of data, which is included in the image file. Thisapplication thus enables the encryption module 12 e to encrypt othertypes of additional data, such as the image data and the shootingcondition. For example, encrypting the image file, which includesthumbnails, only enables display of thumbnails on the image displaydevice, but disables without display of the original image.

[0136] In addition, the public key cryptosystem is applied to theprocess of encryption in accordance with the first enbodiment. Thetechnique of the present invention is also attained in other systems,such as a secret key cryptosystem. In this case, the image processingdevice, which performs the processing on the resulting image file, mayhave decode keys, each of which corresponds to the encryption key thatis prepared based on the manufacturer or the type of the device.

[0137] The DSC 12 has been discussed as the image file generationapparatus, however, a diversity of devices, such as a scanner and avideo camera, may also be used. In the case of using the scanner, datainformation for acquiring the image file 100 may be selected on thecomputer PC, or may be selected on the scanner independently, using apreset button on the scanner, in which set-up information is allocatedpreviously for setting information, and using a display screen and aset-up button on the scanner to be set arbitrarily.

[0138] The file in the Exif format has been discussed as the example ofthe image file 100 in the embodiment, however, the invention is not tobe limited to the format given herein. The available image file mayinclude the image data generated by the image data generation apparatusand the image processing control data that describes conditions for theoutput of the image data. Such a file requires no set-up regarding thecondition of the image processing on the output device for eachprinting, and thereby immediately performs the image processing based onthe specified condition regarding the image processing, so that theimage data, which is generated by the image file generation apparatus,can be output from the output device after the automatic adjustment ofthe picture quality is performed adequately.

INDUSTRIAL APPLICABILITY

[0139] The present invention may be applied for generation of an imagefile, in which image data and additional data are associated oneanother.

1. An image file generation apparatus for generating an image file, inwhich image data and additional data of the image data are associatedone another, comprising: a data input module that inputs the image dataand the additional data; an encryption module that encrypts part of theimage data and the additional data; and an image file generation modulethat generates the image file, in which the image data and theadditional data are associated one another, part of the image file beingencrypted.
 2. An image file generation apparatus in accordance withclaim 1, wherein the encryption module encrypts data using a public keythat is specified by an image processing device that performs specificimage processing on the image data.
 3. An image file generationapparatus in accordance with claim 1, wherein the additional dataincludes image processing control data used for the image processing onthe image data, and wherein the encryption module encrypts at least theimage processing control data.
 4. An image file generation apparatus forgenerating an image file, in which image data and additional data of theimage data are associated one another, comprising: an image data inputmodule that inputs the image data; an additional data input module thatinputs the additional data, at least part of which is encrypted; and animage file generation module that generates the image file, in which theimage data and the additional data, at least part of which is encrypted.5. An image file generation apparatus in accordance with either claim 1or 4, wherein the additional data is output control data that controlsoutput of the image on an image output device.
 6. An image processingdevice performing specific image processing on an image data,comprising: an image file input module that inputs an image file, whichincludes the image data associated with image processing control dataused for image processing on the image data, part of the image filebeing encrypted; a decoder that decodes encrypted part of the imagefile; and an image processing module that performs the specific imageprocessing on the image data, based on the image processing controldata.
 7. An image processing device in accordance with claim 6, furthercomprising: an image processing control data storage module that storesthe image processing control data, wherein the image processing moduleperforms the specific image processing on the image data, based on theimage processing control data stored into the image processing controldata storage module when the encryption module fails to decode theencrypted part of the image file.
 8. An image file generation method forgenerating an image file, which includes image data and additional dataof the image data, comprising the steps of: (a) generating the imagedata and the additional data; (b) encrypting the image data and part ofthe additional data; and (c) generating the image file, which includesthe image data and the associated additional data, part of the imagefile being encrypted.
 9. An image file generation method for generatingan image file, which includes image data and additional data of theimage data, comprising the steps of: (a) generating the image data; (b)acquiring the additional data, part of which is encrypted; and (c)generating the image file, which includes the image data and theassociated additional data, part of which is encrypted.
 10. An imageprocessing method for performing specific image processing on imagedata, comprising the steps of: (a) including the image data and theassociated image processing control data used for image processing onthe image data, and acquiring the image file, part of which isencrypted; (b) decoding encrypted part of the image file; and (c)performing the specific image processing on the image data, based on theimage processing control data.
 11. A computer program that causes acomputer to generate an image file, which includes image data andadditional data of the image data, the computer program attaining thefunctions of: acquiring the image data and the additional data;encrypting the image data and part of the additional data; andgenerating the image file, which includes the image data and theassociated additional data, part of the image file being encrypted. 12.A computer program that causes a computer to generate an image file,which includes image data and additional data of the image data, thecomputer program attaining the functions of: acquiring the image data;acquiring the additional data, at least part of which is encrypted; andgenerating the image file, which stores the image data and theassociated additional data, at least part of which is encrypted.
 13. Acomputer program causing a computer to perform specific image processingon an image data, attaining the functions of including the image dataand the associated image processing control data used for imageprocessing on the image data, and acquiring the image file, part ofwhich is encrypted; decoding encrypted part of the image file; andperforming the specific image processing on the image data, based on theimage processing control data.
 14. A computer readable recording mediumin which a computer program in accordance with one of claims 11 through13 is recorded.
 15. A computer readable recording medium that is appliedto the image file generation apparatus in accordance with claim 4, inwhich at least part of the encrypted additional data is recorded.